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DESCRIPTION 

IMAGE PROCESSING APPARATUS AND TMA CT. PPnn RSSTNP, METHOD 

5 TECHNICAL FIELD 

The present invention relates to an image 
processing apparatus for processing image data, for 
example, obtained by taking an image of a subject and an 
image processing method. 

10 

BACKGROUND ART 
There is conventionally known an identifying device 
for performing individual identifying processing, for 
example, by using image data obtained by taking a picture 

15 of a living body (subject) (refer to, for example, the 
Japanese Unexamined Patent Publication No. 10-127609) . 

In the above conventional identifying device, 
identifying processing is performed, for example, by 
taking a picture of transmitted light of a hand of the 

20 subject and generating binarized image data based on a 
predetermined threshold value of pixel values of the 
image data. For example, the identifying device performs 
identifying processing based on a pattern indicating an 
arrangement of blood vessels in the binarized image data. 

25 A distribution of pixel values of taken image data 



differs in each subject. For example, as to image data of 
a subject with much fat component, the distribution data 
of pixel values spreads in a wide range and an average 
value of pixel values is relatively high comparing with 
5 image data of a subject with less fat component. 

Since the above conventional identifying device 
performs binarization processing based on a predetermined 
threshold value, suitable binarized image data can be 
generated for image data of a subject with less fat 

10 component, while there is a case where binarized data 

having lopsided pixel values is undesirably generated for 
image data of a subject with much fat component and 
binarization processing cannot be performed suitably, so 
that improvement is demanded. 

15 Also, image data obtained by taking a picture of a 

subject includes very small regions equivalent to noise 
components, and the noise components largely affects on 
accuracy of identifying processing. Therefore, there has 
been a demand to remove regions of a predetermined size 

20 equivalent to noise components from the image data. 

Also, a linear pattern in the image data is 
significant in the identifying processing, but the linear 
pattern is broken due to noise, etc. and cannot be 
visually recognized clearly in some cases. Therefore, 

25 there is a demand for obtaining image data including a 



clear linear pattern by connecting between pixel data 
close to each other to a certain extent by considering 
noise, etc. 

5 DISCLOSURE OF THE INVENTION 

An object of the present invention is to provide an 
image processing apparatus and an image processing method 
capable of suitably performing binarization processing 
even in the case where distribution data of pixel values 

10 differs in each subject. 

Another object of the present invention is to 
provide an image processing apparatus and an image 
processing method capable of removing regions being 
smaller than a predetermined size from image data 

15 obtained by taking a picture of a subject and connecting 
pixel data close to a certain extent to each other. 

To attain the above object, an image processing 
apparatus of a first aspect of the present invention is 
an image processing apparatus, comprising: a distribution 

20 data generation means for generating distribution data 
indicating a distribution of pixel data for a plurality 
of pixel data indicating pre-regulated pixel values in 
the first range and composing first image data obtained 
by taking a picture of a subject; a specifying means for 

25 specifying a second range to be binarized in the first 



range based on the distribution data generated by the 
distribution data generation means; a mapping means for 
mapping pixel data in the second range specified by the 
specifying means among a plurality of pixel data to the 
5 first range, and generating second image data composed of 
the mapped pixel data; and a binarization means of 
binarizing the second image data generated by the mapping 
means based on a threshold value regulated in the first 
range to generate a third image data. 

10 According to the image processing apparatus of the 

first aspect of the present invention, the distribution 
data generation means generates distribution data 
indicating a distribution of pixel data for a plurality 
of pixel data indicating pre-regulated pixel values in 

15 the first range composing first image data obtained by 
taking a picture of a subject. 

The specifying means specifies a second range to be 
binarized in the first range based on the distribution 
data generated by the distribution data generation means. 

20 The mapping means maps pixel data in the second 

range specified by the specifying means among a plurality 
of pixel data to the first range, and generates second 
image data composed of the mapped pixel data . 

The binarization means binarizes the second image 

25 data generated by the mapping means based on a threshold 
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value regulated in the first range to generate third 
image data . 

Furthermore, to attain the above objects, an image 
processing apparatus of a second aspect of the present 

5 invention is an image processing apparatus, comprising: a 
first processing means for indicating a pixel value and 
using as a pixel data the minimum pixel data in the first 
region around the pixel data, for each of a plurality of 
pixel data composing the first image data obtained by a 

10 taking a picture of a subject; and a second processing 

means for generating a second image data by using as the 
pixel data the maximum pixel data among pixel data in the 
second region larger than the first region around the 
pixel data for each of image data by the first processing 

15 means . 

Furthermore, to attain the above objects, an image 
processing method of a third aspect of the present 
invention is an image processing method, including: a 
first step for generating distribution data indicating a 

20 distribution of pixel data for a plurality of pixel data 
indicating pre-regulated pixel values in the first range 
and composing first image data obtained by taking a 
picture of a subject; a second step for specifying a 
second range to be binarized in the first range based on 

25 the distribution data generated by the first step; a 



third step for mapping pixel data in the second range 
specified by the second step among a plurality of pixel 
data to the first range, and generates second image data 
composed of the mapped pixel data; and a forth step for 
binarizing the second image data generated by the fourth 
step on a threshold value regulated in the first range to 
generate third image data. 

Furthermore, to attain the above objects, an image 
processing method of a fourth aspect of the present 
invention is an image processing method, including: a 
first step for indicating a pixel value and using as a 
pixel data the minimum pixel data in the first region 
around the pixel data, for each of a plurality of pixel 
data composing the image data obtained by a taking a 
picture of a subject; and a second step for generating a 
second image data by using as a pixel data the maximum 
pixel data among pixel data in the second region being 
larger than the first region around the pixel data by the 
first step. 

According to the present invention, it is possible 
to provide an image processing apparatus and an image 
processing method capable of suitably performing 
binarization processing even in the case where 
distribution data of pixel values differs for each 
subject . 



Also, according to the present invention, it is 
possible to provide an image processing apparatus and an 
image processing method capable of removing regions being 
smaller than a predetermined size from image data 
5 obtained by taking a picture of a subject and connecting 
between pixel data being close to a certain extent. 

BRIEF DESCRIPTION OF DRAWINGS 
FIG. 1 is an overall schematic view of a first 
10 embodiment of a data processing apparatus according to 
the present invention. 

FIG. 2 is a block diagram in terms of hardware of 
the data processing apparatus shown in FIG. 1. 

FIG. 3 is a block diagram of a function of the data 
15 processing apparatus shown in FIG. 1. 

FIG. 4A to FIG. 4E are views for explaining an 
operation of the data processing apparatus shown in FIG. 
1. FIG. 4A is a view showing an example of image data Sll. 
FIG. 4B is a view showing an example of image data S1081. 
20 FIG. 4C is a view showing an example of distribution data 
dl . FIG. 4D is an enlarged view of distribution data. FIG. 
4E is a view showing an example of image data S1084 . 

FIG. 5A and FIG. 5B are views for explaining an 
operation of a specific portion shown in FIG. 3. FIG. 5A 
25 is a view showing an example of distribution data dl . FIG. 



5B is a view showing an example of distribution data dl' . 

FIG. 6 is a flowchart for explaining an operation 
according to mapping processing of the data processing 
apparatus shown in FIG. 1. 
5 FIG. 7 is a block diagram of a function according 

to filter processing of the data processing apparatus 
shown in FIG. 1. 

FIG. 8 is a view for explaining a Gaussian filter. 
FIG. 9A to FIG. 9F are views for explaining a 

10 Gaussian Laplacian filter. FIG. 9A is a view showing an 
example of step-shaped pixel values. FIG. 9B is a view 
showing an example of pixel values. FIG. 9C is a view 
showing pixel values subjected to first-order 
differential processing. FIG. 9D is a view showing an 

15 example of pixel values. FIG. 9E is a view showing an 

example of pixel values subjected to primary differential 
processing. FIG. 9F is a view showing an example of pixel 
values subjected to second-order differential processing. 

FIG. 10A to FIG. 10C are views for explaining noise 

20 removing processing of the data processing apparatus 

shown in FIG. 1. FIG. 10A is a view showing an example of 
image data S1804. FIG. 10B is a view showing an example 
of image data S1805. FIG. 10C is a view showing an 
example of image data S1806. 

25 FIG. 11 is a flowchart for explaining an operation 
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of the data processing apparatus shown in FIG. 1. 

FIG. 12A to FIG. 12D are schematic views for 
explaining an operation of the data processing apparatus 
shown in FIG. 1. FIG. 12A is a view showing an example of 
5 image data including noise components. FIG. 12B is a view 
showing an example of image data subjected to noise 
removing processing. FIG. 12C is a view showing an 
example of image data. FIG. 12D is a view showing an 
example of image data subjected to connection processing. 

10 FIG. 13A to FIG. 13F are views for explaining 

degeneration processing and expansion processing of data 
processing apparatus shown in FIG. 1. FIG. 13A is a view 
showing an example of pixel data. FIG. 13B is an example 
of pixel data when degeneration processing is performed 

15 based on pixels in a cross-shaped element. FIG. 13C is an 
example of pixel data when expansion processing is 
performed based on pixels in a cross-shaped element. FIG. 
13D is a view showing an example of pixel data. FIG. 13E 
is an example of pixel data when degeneration processing 

20 is performed based on pixels in 3x3 element. 

FIG. 14A to FIG. 14C are views for explaining an 
operation of the data processing apparatus shown in FIG. 
1. FIG. 14A is a view showing an example of image data 
S1807. FIG. 14B is a view showing an example of image 

25 data S1808. FIG. 14C is a view showing an example of 
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image data S1810. 

FIG. 15 is a flowchart for explaining an operation 
of the data processing apparatus shown in FIG. 1. 

FIG. 16A to FIG. 16F are views for explaining an 
5 operation of a first low-pass filter processing of the 
data processing apparatus shown in FIG. 1. FIG. 16A is a 
view showing an example of a reference region in a two- 
dimensional Fourier space. FIG. 16B is a view showing an 
example of an enlarged reference region by predetermined 

10 magnification. FIG. 16C is a view showing an example of a 
low-pass filter. FIG. 16D is a view showing an example of 
image data. FIG. 16E is a view showing an example of 
image data subjected to low-pass filter processing. FIG. 
16F is a view showing an example of image data subjected 

15 to binarization processing. 

FIG. 17A to FIG. 17E are views for explaining an 
operation of second low-pass filter processing of a low- 
pass filter portion. FIG. 17A is a view showing an 
example of a reference region in a two-dimensional 

20 Fourier space. FIG. 17B is a view showing an example of a 
low-pass filter. FIG. 17C is a view showing an example of 
image data. FIG. 17D is a view showing an example of 
image data subjected to low-pass filter processing. FIG. 
17E is a view showing an example of image data subjected 

25 to binarization processing. 
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FIG. 18A to FIG. 18E are views for explaining an 
operation of third low-pass filter processing of the low- 
pass filter portion. FIG. 18A is a view showing an 
example of a reference region in the two-dimensional 
5 Fourier space. FIG. 18B is a view showing an example of a 
low-pass filter. FIG. 18C is a view showing an example of 
image data. FIG. 18D is a view showing an example of 
image data subjected to low-pass filter processing. FIG. 
18E is a view showing an example of image data subjected 

10 to binarization processing. 

FIG. 19A to FIG. 19F are views for explaining an 
operation of the low-pass filter portion of the data 
processing apparatus shown in FIG. 1. FIG. 19A is a view 
showing an example of image data S1810. FIG. 19B is a 

15 view showing an example of image data S18102 . FIG. 19C is 
a view showing an example of image data S18103. FIG. 19D 
is a view showing an example of image data S18102. FIG. 
19E is a view showing an example of image data S18104 . 
FIG. 19F is a view showing an example of image data 

20 S18105. 

FIG. 20A to FIG. 20C are views for explaining an 
operation of the low-pass filter portion of the data 
processing apparatus shown in FIG. 1. FIG. 20A is a view 
showing an example of image data S1804 . FIG. 20B is a 
25 view showing an example of image data S18106. FIG. 20C is 
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a view showing an example of image data S1811. 

FIG. 21 is a flowchart for explaining an operation 
of the low-pass filter portion of the data processing 
apparatus shown in FIG. 1. 
5 FIG. 22A to FIG. 22C are views for explaining an 

operation of a mask portion and a skeleton portion of the 
data processing apparatus shown in FIG. 1. FIG. 22A is a 
view showing an example of a mask pattern. FIG. 22B is a 
view showing an example of image data S1812. FIG. 22C is 
10 a view showing an example of image data S1813. 

FIG. 23 is a flowchart for explaining an overall 
operation of the data processing apparatus shown in FIG. 
1. 

FIG. 24 is a view for explaining a second 
15 embodiment of a remote-control device using a data 

processing apparatus according to the present invention. 

FIG. 25 is a flowchart for explaining an operation 
of a remote-control device la shown in FIG. 24. 

FIG. 26 is a view for explaining a third embodiment 
20 of a data processing system using the data processing 
apparatus according to the present invention. 

FIG. 27 is a flowchart for explaining an operation 
of the data processing system shown in FIG. 26. 

FIG. 28 is a view for explaining a fourth 
25 embodiment of a portable communication device using the 
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data processing apparatus according to the present 
invention . 

FIG. 29 is a flowchart for explaining an operation 
of the data processing apparatus shown in FIG. 28. 
5 FIG. 30 is a view for explaining a fifth embodiment 

of the data processing apparatus according to the present 
invention . 

FIG. 31 is a flowchart for explaining an operation 
of a telephone shown in FIG. 30. 
10 FIG. 32 is a view for explaining a sixth embodiment 

of the data processing apparatus according to the present 
invention . 

FIG. 33 is a view for explaining a seventh 
embodiment of the data processing apparatus according to 
15 the present invention. 



BEST MODE FOR CARRYING OUT THE INVENTION 
An image processing apparatus according to the 
present invention generates distribution data indicating 
20 a distribution of pixel data, specifies a second range to 
be binarized, maps pixel data in the second range to a 
first range, generates image data composed of the mapped 
pixel data, and binarizes the image data based on a 
threshold value regulated in the first range to generate 
25 binarized image data, based on image data obtained by 
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taking a picture of a subject, for a plurality of pixel 
data composing the image data and indicating pixel values 
of a first range regulated in advance. 

Furthermore, an image processing apparatus 
5 according to the present invention eliminates regions 
being smaller than a predetermined size from the image 
data obtained by taking a picture of the subject and 
connects between pixel data close to a certain extent to 
each other . 

10 Specifically, the image processing apparatus 

generates second image data for each of the plurality of 
pixel data composing first image data obtained by taking 
a picture of the subject and indicating pixel values, by 
using as the pixel data minimum pixel data among pixel 

15 data in the first region around the pixel data and, 

furthermore, using as pixel data maximum pixel data among 
pixel data in a second region being larger than the first 
region around the pixel data for each of the pixel data. 

Below, as a first embodiment of an image processing 

20 apparatus according to the present invention, a data 

processing apparatus for generating image data by taking 
a picture of a part with blood vessels of a living body 
of a subject h, extracting blood vessel information by 
performing image processing oh the image data, and 

25 performing authentication processing based on the 
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extracted blood vessel information will be explained. 

FIG. 1 is an overall schematic view of the first 
embodiment of the data processing apparatus according to 
the present invention. 
5 A data processing apparatus 1 according to the 

present embodiment comprises, as shown in FIG. 1, an 
image pickup system 101, an extraction unit 102, and an 
authentication unit 103. The data processing apparatus 1 
corresponds to an example of an image processing 
10 apparatus according to the present invention. 

The image pickup system 101 takes a picture of a 
subject h to generate image data and outputs the image 
data as a signal Sll to the extraction unit 102. 

The image pickup system 101 specifically comprises 
15 an irradiation portion 1011 and an optical lens 1012. 

The irradiation portion 1011 is composed, for 
example, of a halogen lamp, etc. and irradiates an 
electromagnetic wave, for example a near infrared ray, to 
a part of the subject h by a control signal. 
20 For example, when irradiating an electromagnetic 

wave to a living body as the subject h, a near infrared- 
ray from red to infrared ray having a wavelength range of 
600 nm to 1300 nm or so exhibits a high penetrating 
property comparing with that of electromagnetic waves of 
25 other wavelength ranges. In this wavelength range, light 



16 

absorption by hemoglobin in blood is dominant. 

For example, when irradiating a near infrared ray 
from back of a hand as the subject h and taking a picture 
of a transmitted light from the palm side, the 
5 electromagnetic wave is absorbed by hemoglobin in blood, 
so that image data, wherein a region corresponding to 
thick blood vessels near the palm surface is darker than 
region other than the region corresponding to blood 
vessels, is obtained. 

10 Vein of blood vessels is acquired in the process of 

growing up and the shape of the blood vessels largely 
varies between individuals. In the present embodiment, 
image data obtained by taking a picture of the blood 
vessels is used as individually unique identification 

15 information in authentication processing. 

The optical lens 1012 focuses the transmitted light 
from the subject h on the image pickup unit 11. 

The image pickup unit 11 generates image data Sll 
based on the transmitted light focused by the optical 

20 lens 1012. For example, the image pickup unit 11 is 
composed of a CCD (charge -coupled device) type image 
sensor and a C-MOS (complementary metal -oxide 
semiconductor) type image sensor, and outputs the image 
data Sll to the extraction unit 102. At this time, the 

25 image data Sll may be an RGB (red, green and blue) signal 
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or image data of other colors than that and gray-scale, 
etc. 

The extraction unit 102 performs image processing 
based on the image data Sll, extracts image data used for 
5 authentication, such as skeleton image data, and outputs 
this as a signal S102 to the authentication unit 103. 

The authentication unit 103 performs matching 
processing with registered image data stored in advance 
based on the signal S102 from the extraction unit 102 and 
10 performs authentication processing. 

FIG. 2 is a block diagram in terms of hardware of 
the data processing apparatus shown in FIG. 1. 

The data processing apparatus 1 comprises, for 
example as shown in FIG. 2, an image pickup unit 11, an 
15 input unit 12, an output unit 13, a communication 

interface (I/F) 14, a RAM (random access memory) 15, a 
ROM (read only memory) 16, a memory unit 17, and a CPU 18. 

The image pickup unit 11, the input unit 12, the 
output unit 13, the communication interface (I/F) 14, the 
20 RAM 15, the ROM 16, the memory unit 17 and the CPU 

(central processing unit) 18 are connected by a bus BS . 

The image pickup unit 11 is controlled by the CPU 
18 and generates image data of the subject h and outputs 
this as a signal Sll. 
25 The input unit 12 outputs a signal, for example, in 
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accordance with an operation of a user to the CPU 18. For 
example, the input unit 12 is composed of a keyboard, a 
mouse and a touch panel, etc. 

The output unit 13 is controlled by the PCU 18 and 
5 performs outputting in accordance with predetermined data. 
For example, the output unit 13 is composed of a display 
or other display devices. 

The communication interface (I/F) 14 is controlled 
by the CPU 18 and performs data communication with other 
10 data processing apparatuses, for example, via a not shown 
communication network . 

The RAM 15 is for example used as a work space of 
the CPU 18. 

The ROM 16 stores data, such as initial values and 
15 initial parameters, and the data is used by the CPU 18. 

In the memory unit 17, predetermined data is 
written and read by the CPU 18. For example, the memory 
unit 17 is composed of an HDD (hard disk drive) and other 
memory devices. 

20 The memory unit 17 comprises, for example as shown 

in FIG. 2, a program PRG and image data D_P, etc. 

The program PRG includes functions according to an 
embodiment of the present invention, such as functions of 
the extraction unit 102 and the authentication unit 103, 

25 and the functions are realized by being executed by the 
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CPU 18. 

The image data D_P is image data, such as 
registered image data, for example, used in the 
authentication processing. 
5 FIG. 3 is a block diagram of functions of the data 

processing apparatus shown in FIG. 1. 

For example, the CPU 18 realizes as functions of 
the extraction unit 102, functions of a gray-scale 
conversion portion 1801, a distribution data generation 
10 portion 1802, a specifying portion 1803, a mapping 
portion 1804, a Gaussian filter 1805, a Gaussian 
Laplacian 1806, a first degeneration processing portion 
1807, a first expansion processing portion 1808, a second 
expansion processing portion 1809, a second degeneration 
15 processing portion 18010, a low-pass filter portion 1811, 
a mask portion 1812 and a skeleton portion 1813, by 
executing the program PRG as shown in FIG. 3. 

The present invention is not limited to this 
embodiment. For example, the functions of components 
20 shown in FIG. 3 may be realized by hardware. 

The distribution data generation portion 1802 
corresponds to an example of a distribution data 
generation means according to the present invention, and 
the specifying portion 1803 corresponds to an example of 
25 a specifying means according to the present invention. 
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The mapping portion 1804 corresponds to an example 
of a mapping means according to the present invention, 
and the low-pass filter portion 1811 corresponds to an 
example of a filter processing means according to the 
5 present invention . 

The Gaussian filter 1805, the Gaussian Laplacian 
1806, the first degeneration processing portion 1807, the 
first expansion processing portion 1808, the second 
expansion processing portion 1809, the second 

10 degeneration processing portion 1810, the low-pass filter 
portion 1811, the mask portion 1812 and the skeleton 
portion 1813 correspond to an example of a binarization 
means according to the present invention. 

The first degeneration processing portion 1807 

15 corresponds to a first processing means according to the 
present invention, the first expansion processing portion 
1808 corresponds to an example of a fourth processing 
means according to the present invention, the second 
expansion processing portion 1809 corresponds to an 

20 example of a second processing means according to the 

present invention, and the second degeneration processing 
portion 1810 corresponds to an example of a third 
processing means according to the present invention. 

The gray-scale conversion portion 1801 converts the 

25 RGB signal Sll from the image pickup unit 11 to be gray- 

L 
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scale and outputs as a signal S1801 to the distribution 
data generation portion 1802. Specifically, the gray- 
scale conversion portion 1801 converts the RGB signal to 
predetermined tones from white to black, for example, 256 
5 tones . 

In the present embodiment, the image pickup unit 11 
generates the RGB signal Sll and the gray-scale 
conversion portion 1801 performs conversion processing to 
gray scale on the signal Sll, but the present invention 

10 is not limited to this embodiment. For example, when the 
image pickup unit 11 generates gray scale image data Sll, 
the gray scale conversion portion 1801 is not provided. 

FIG. 4A to FIG. 4E are views for explaining an 
operation of the data processing apparatus shown in FIG. 

15 1. 

In the present embodiment, the image pickup unit 11 
takes a picture of, for example, a finger of a living 
body of the subject h and outputs an RGB image data Sll 
as shown in FIG. 4A. 

20 The gray scale conversion portion 1801 generates 

gray scale image data S1802, for example, as shown in FIG. 
4B based on the image data Sll and outputs to the 
distribution data generation portion 1802. 

The distribution data generation portion 1802 

25 generates distribution data dl indicating a distribution 
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of pixel data based on the signal SI 801 from the gray 
scale conversion portion 1801, for a plurality of pixel 
data composing image data and indicating pixel values in 
the first range regulated in advance, and outputs as a 
5 signal S1802 to the specifying portion 1803. 

Specifically, when assuming the abscissa "c" is a 
value of tones (also referred to as a pixel value) and 
the ordinate "f" is the number of the pixel data (also 
referred to as a degree) , the distribution data 

10 generation portion 1802 generates histogram as 

distribution data dl for pixel data indicating pixel 
values of a range of 256 tones as a first range rl as 
shown in FIG. 4C based on the signal S1801. In FIG. 4C, a 
small pixel value corresponds to black, and a large pixel 

15 value corresponds to white. 

Specifically, the distribution data generation 
portion 1802 generates distribution data dl indicating 
the number of pixel data having pixel values for the 
respective pixel values in the first range rl . 

20 FIG. 5A and FIG. 5B are views for explaining an 

operation of the specifying portion shown in FIG. 3. 

The specifying portion 1803 specifies, based on the 
signal S1802, a range with the maximum pixel value or 
less among the pixel values of predetermined number of 

25 pixel data in the first range rl as a second range r2 to 



be binarized, and outputs this as a signal S1803. 

Specifically, for example as shown in FIG. 5A, the 
specifying portion 1803 specifies as a second range r2 a 
range with the maximum pixel of value rll or less among 
5 pixel values rll, rl2 , rl3 and rl4 by the number of 

predetermined threshold value V_th in the first range rl . 

For example, the specifying portion 1803 specifies 
as a second range r2 a range with pixel values of 1 to 
110 in the case of the distribution data dl as shown in 
10 FIG. 5A. 

Distribution data of pixel values of the subject h 
differs in each subject h. For example, comparing with 
image data of a subject with less fat component, the 
histogram dl' of image data of a subject with much fat 

15 component exhibits distribution data dl' spreading in a 
wide range and has a relatively high average value of 
pixel values as shown in FIG. 5B. 

For example, in the case of the distribution data 
dl' as shown in FIG. 5B, the specifying portion 1803 

20 specifies as a second range r2' a range with pixel values 
of not more than the maximum pixel value rll' among the 
pixel values rll' , rl2' , rl3' and rl4' by the number of a 
predetermined threshold value V_th in the first range rl . 
The mapping portion 1804 maps pixel data in the 

25 second range r2 specified by the specifying portion 1803 
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among the plurality of pixel data to the first range rl , 
generates second image data composed of the mapped pixel 
data, and outputs this as a signal S1804 . 

Specifically, for example, when assuming that a 
5 range of pixel values of 0 to 110 is a second range r2 as 
shown in FIG. 4C, the mapping portion 1804 performs 
mapping by enlarging the pixel data to the first range rl 
as a range of pixel values of 0 to 256 as shown in FIG. 
4D, enlarges the center portion in image data not 

10 including blood vessel information as shown in FIG. 4E , 
and generates second image data S1804. 

FIG. 6 is a flowchart for explaining an operation 
according to the mapping processing of the data 
processing apparatus shown in FIG. 1. With reference to 

15 FIG. 4, FIG. 5A, FIG. 5B and FIG. 6, an operation of the 
distribution data generation portion 1802, the specifying 
portion 1803 and the mapping portion 1804 will be 
explained. 

The image pickup unit 11 takes a picture of the 
20 subject h and outputs image data Sll to the gray scale 

conversion portion 1801. The image data Sll is converted 
to gray scale of 256 tones by the gray scale conversion 
portion 1801 and input as a signal S1801 to the 
distribution data generation portion 1802. 
25 In a step ST1, for example as shown in FIG. 4C, 



based on the signal S1801, for a plurality of pixel data 
composing image data S and indicating pixel values in the 
first range rl regulated in advance, the distribution 
data generation portion 1802 generates distribution data 
5 dl indicating the number of pixel data having the pixel 
values and outputs as a signal S1802 to the specifying 
portion 1803. 

In a step ST2 , as shown in FIG, 4C, based on the 
signal S1802, the specifying portion 1803 specifies as a 

10 second range r2 to be binarized a range with pixel values 
of not more than the maximum pixel value rll among pixel 
values in pixel data by the predetermined number, for 
example a threshold value V_th, in the first range rl , 
and outputs as a signal S1803 to the mapping portion 1804 . 

15 In a step ST3 , as shown in FIG. 4D, the mapping 

portion 1804 maps pixel data in the second range r2 
specified by the specifying portion 1803 among the 
plurality of pixel data to the first range rl based on 
the signal S1803, generates second image data composed of 

20 the mapped pixel data and outputs as a signal S1804 . 

In a step ST4 , the second image data S1804 
generated in the mapping portion 1804, for example, by 
later explained components 1085 to 1812, etc. is 
binarized based on the regulated threshold value 

25 regulated in the first range rl , for example 100 tones, 
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and generates third image data. 

As explained above, in the present embodiment, for 
example as shown in FIG. 4C and FIG. 4D, as a result that 
distribution data is generated by the distribution data 
5 generation portion 1802, a second range is specified by 
the specifying portion 1803, the pixel data in the second 
range is mapped to the first range by the mapping portion 
1804, and image data is generated by binarization based 
on a threshold value regulated in the first range rl by 

10 the later explained components 1805 to 1812; binarization 
processing can be suitably performed even when 
distribution data dl differs in each subject h. 

Also, since the pixel data in the specified second 
range is mapped to the first range, the contrast becomes 

15 high and binarization processing can be suitably 
performed. 

The data processing apparatus 1 according to the 
present embodiment performs edge enhancement processing 
after performing noise removing processing on the image 

20 data generated in the above steps. For example, the data 
processing apparatus 1 performs any processing among a 
plurality of different noise removing processing based on 
the signal S1804, and performs edge enhancement 
processing after the noise removing processing. 

25 FIG. 7 is a block diagram of a function according 



to filter processing of the data processing apparatus 
shown in FIG. 1. 

The CPU 18 realizes functions of a selection 
portion 1814 and a plurality of noise removing filters 
5 1815 shown in FIG. 7, for example, by executing the 
program PRG . 

The noise removing filter 1815 corresponds to an 
example of a noise removing means according to the 
present invention . 

10 The selection portion 1814 outputs to the noise 

removing filter 1815 a signal S1814 for selecting any 
noise removing filter among a plurality of noise removing 
filters for performing different noise removing 
processing among the noise removing filter 1815. 

15 For example, the selection portion 1814 detects 

noise distribution characteristics of the signal S1804 
and outputs a signal S1814 for selecting a noise removing 
filter suitable to the noise characteristics based on the 
detection result. 

20 Also, for example, the selection portion 1814 may 

output a signal S1814 for selecting the noise removing 
filter based on the signal from the input unit 12 in 
accordance with an operation of a user. 

The noise removing filter 1815 comprises a 

25 plurality of filters for noise removing processing, for 
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example, a Gaussian filter 1815_1, a median filter 1815_2, 



1815 4, a two-dimensional adaptive noise removing filter 
1815_5, a proximity filter 1815_6, an averaging filter 
5 1815_7, a Gaussian low-pass filter 1815_8, a two- 
dimensional Laplacian proximity filter 1815_9, and a 
Gaussian Laplacian filter 1815_10; selects any (at least 
one) noise removing filter, for example, in accordance 
with the signal S1814 from the selection portion 1814, 

10 performs noise removing processing on the signal S1804 
with the selected noise removing filter, and generates 
image data S1806. 

Below, the filter processing will be explained. 
Generally, filter processing is performed with a filter h 

15 (nl, n2) on image data u (nl , n2) , wherein a grid point 
(nl, n2) on the two-dimensional plane is a variable, and 
image data v (nl, n2) is generated as show in the formula 
(1). Here, convolution integral is indicated as . 



a maximum value filter 1815 3, a minimum value filter 



v("!," 2 ) - uin^n 2 yh{n x ,n 2 ) 
= 7 y A(An 1? m 2 )w(72 1 -m 1? n 2 -m 2 ) 





20 



(1) 



The Gaussian filter 1815_1 performs convolution 



processing on a Gauss function hg (nl , n2) as shown in 
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the formula (2) , for example, by using a standard 
deviation a. Specifically, as shown in the formulas (3) 
and (1) , noise removing processing is performed by using 
the Gaussian filter h (nl, n2) . 



FIG. 8 is a view for explaining a Gaussian filter. 

The Gaussian filter 1815_1 is a smoothing filter 
and performs smoothing processing by calculating by 
weighting in accordance with a two dimensional Gauss 
distribution, wherein focused pixel data is at the center, 
for example, as shown in FIG. 8. For example, focused 
pixel data is (0, 0) in FIG. 8. 

For example, when arranging pixel data in a local 
region of nxn, wherein the focused pixel data is at the 
center, the median filter 1815_2 uses a pixel value of 
the pixel data in the middle of the order as a pixel 
value of the focused pixel data. 

The maximum value filter 1815_3 uses a pixel value 
of the maximum value as a pixel value of the focused 




(2) 





(3) 
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pixel data, for example, among pixel data of a local 
region of nxn, wherein the focused pixel is at the center. 

The minimum value filter 1815_4 uses a pixel value 
of the minimum value as a pixel value of the focused 
5 pixel data, for example, among pixel data of a local 

region of nxn, wherein the focused pixel is at the center. 

The two-dimensional adaptive noise removing filter 
1815_5 is, for example, a so-called Wiener filter and 
performs filter processing to minimize a mean square 
10 error with respect to image data based on the image data 
to improve the image. 

The proximity filter 1815_6 is filter processing 
for calculating an output pixel based on a pixel value of, 
for example, nxn pixel among image data. Specifically, 
15 for example, the proximity filter 1815_6 performs filter 
processing based on the maximum value, minimum value and 
standard deviation from a proximity value in accordance 
with the data. 

The averaging filter 1815_7 performs filter 
20 processing by calculating an average value of pixel 

values of, for example, nxn pixel among the image data 
and using the same as an output pixel . 

The Gaussian low-pass filter 1815_8 performs noise 
removing and smoothing processing. Specifically, the 
25 Gaussian low-pass filter 1815_8 performs smoothing 



31 



processing on image data based on Gaussian type weighting. 

The two-dimensional Laplacian proximity filter 
1815_9 performs second-order differential processing to 
perform edge detection based on the image data. 

The Gaussian Laplacian filter 1815_10 performs 
filter processing wherein a Gaussian filter calculates a 
Laplacian (second-order differential) . A detailed 
explanation will be given below. 

The Laplacian can be expressed, for example, as 
shown in the formula (4) in the two-dimension Euclidean 
coordinate system. 



Also, the Laplacian can be expressed in matrix of 
3x3 as shown in the formula (5), for example, by using a 
predetermined value a. Here, the focused pixel is made to 
be the center of the matrix. 




d z d 2 
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(4) 



a 



1-a 



a 




4 



4 

1-a 



-1 



4 



4 

1-a 



(£1+1) 



4 



4 



a 



4 



1-a 
4 



4 



32 



(5) 



The Laplacian of a Gaussian filter performs 
convolution processing on the Gauss function hg (nl , n2) 
as shown in the formula (6) , for example, by using the 
standard deviation a. Specifically, as shown in the 
formulas (7) and (1) , noise removing processing is 
performed by using the Gaussian Laplacian filter h (nl , 
n2) . 



Also, the Laplacian of the Gaussian filter can be 
expressed, for example, as shown in the formula (8) when 
expressed in matrix by using a predetermined value a. 
Here, the focused pixel is made to be at the center of 
the matrix. 




(6) 
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(8) 



FIG. 9A to FIG. 9F are views for explaining a 
Gaussian Laplacian filter. For a plane explanation, the 
5 image data is assumed to be one-dimensional. 

An edge is a boundary of a plane and a plane 
generated by a change of pixel values (brightness) . An 
edge can be detected by performing spatial differential. 
For example, there are first-order differential and 
10 second-order differential . 

For example, the case of a step-shaped pixel value 
f (x) shown in FIG. 9A will be explained. Here, the 
ordinate axis is a pixel value and the abscissa axis is 
the x-axis. 

15 Specifically, an edge region continuously changes 

with a predetermined width L between the first pixel 
value fl and the second pixel value f2 as shown in FIG. 
9B. When assuming that the image data f (x) is first-order 
differential processing, it sharply changes at a 

20 predetermined width L in the boundary region, for example, 
as shown in FIG. 9C. 

For example, edge detection processing detects an 
abrupt change of image f ' (x) after the first-order 
differential processing and specifies the edge. 

25 Also, the edge detection processing may perform 



detection by quadratic differential processing 
(Laplacian) . 

For example, in the case where image data is a 
pixel value f (x) shown in FIG. 9D, a first-order 
5 differential value f ' (x) shown in FIG. 9E and a second- 
order differential value f ' ' (x) shown in FIG. 9F shown in 
FIG. 9F are obtained. 

The second-order differential value f ' ' (x) changes 
its sign at a point where tilt is the largest on a slope 
10 of the edge. Accordingly, a point where the second-order 
differential crosses with the x-axis (referred to as a 
zero cross point) P_cr indicates the edge position. The 
image data is two-dimensional data and specifies as an 
edge a position of the zero crossing point P_cr among 
15 image data subjected to second-order differential 
processing at the time of actual edge detection. 

For example, the case where the selection portion 
1814 selects the Gaussian filter 1815__1 and the Gaussian 
Laplacian filter 1815_10 for noise removing processing 
20 will be explained. For example as shown in FIG. 3, it is 
assumed that a Gaussian filter 1805 is the Gaussian 
filter 1815_JL and a Gaussian Laplacian filter 1806 is the 
Gaussian Laplacian filter 1815_10. 

FIG. 10A to FIG. 10C are views for" explaining noise 
25 removing processing of the data processing apparatus 
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shown in FIG. 1. FIG. 11 is a flowchart for explaining an 
operation of the data processing apparatus shown in FIG. 
1. With reference to FIG. 10A to FIG. IOC and FIG. 11, an 
operation of the data processing apparatus, particularly 
5 an operation regarding noise removing processing will be 
explained. 

In a step ST11, for example, the selection portion 
1814 detects noise distribution characteristics of a 
signal S1804 and outputs a signal S1814 to select a noise 

10 removing filter suitable to the noise characteristics 
based on the detected results to the noise removing 
filter 1815. For example, the selection portion 1814 
outputs to the noise removing filter 1815 a signal S1814 
to select the Gaussian filter 1815_1 and the Gaussian 

15 Laplacian filter 1815_10 for the noise removing 
processing. 

In a step ST12, any (at least one) noise removing 
filter is selected based on the signal S1814 in the noise 
removing filter 1815, noise removing processing is 
20 performed on the signal S1814 by the selected noise 
removing filter, and image data S1806 is generated. 

For example, the noise removing filter 1815 selects 
the Gaussian filter 1815_1 and the Gaussian Laplacian 
filter 1815_10. For convenience of the explanation, the 
25 Gaussian filter 1815 1 and the Gaussian Laplacian filter 
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1815_10 are respectively explained as the Gaussian filter 
1805 and the Gaussian Laplacian filter 1806. 

In the step ST12, the Gaussian filter 1805 performs 
noise removing processing shown in the formulas (1) and 
5 (3) , for example, based on the signal S1804 shown in FIG. 
10A, generates image data S1805, for example, shown in 
FIG. 10B, and outputs to the Gaussian Laplacian filter 
1806. 

In a step ST13, the Gaussian Laplacian filter 1806 
10 performs edge enhancement processing based on the signal 
S1805, for example, as shown in FIG. 10B, generates image 
data S1806, for example, as shown in FIG. 10C, and 
outputs the same. The image data S1806 is binarized image 
data . 

15 The Gaussian Laplacian filter 1806 performs 

binarization processing based on a threshold value 
regulated in the first range rl , for example shown in FIG. 
4C, when performing binarization processing. 

As explained above, as a result that the selection 

20 portion 1814 for selecting any noise removing processing 
among a plurality of noise removing processing and as 
noise removing filters 1815, for example, the Gaussian 
filter 1815_1, the median filter 1815__2, the maximum 
value filter 1815_3, the minimum value filter 1815_4, the 

25 two-dimensional adaptive noise removing filter 1815_5, 
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the proximity filter 1815_6, an averaging filter 1815_7, 
the Gaussian low-pass filter 1815_8, the two-dimensional 
Laplacian proximity filter 1815_9, and the Gaussian 
Laplacian filter 1815_JL0 are provided; and, for example, 
5 a filter selected by the selection portion 1814 performs 
the noise removing processing based on the signal S1804; 
then, edge enhancement processing is performed by the 
Gaussian Laplacian filter 1806 for binarization ; it is 
possible to generate suitably binarized image data based 

10 on the predetermined threshold value of the first range 
rl by removing, for example, noises caused by diffused 
reflection of a body of a subject h, the image pickup 
unit 11 and other devices, from the image data S1804 . 

Also, since the selection portion 1814 selects a 

15 filter in accordance with the noise characteristics, 
noises can be removed with high accuracy. 

Also, for example, by performing Gaussian filter 
processing and Gaussian Laplacian filter processing on 
the image data generated by taking a picture of light 

20 transmitted through a part including blood vessels of the 
subject h, noises can be removed with high accuracy, 
binarization processing can be suitably performed and it 
is possible to generate an image wherein a pattern 
indicating blood vessels can be visually recognized. 

25 FIG. 12A to FIG. 12D are schematic views for 
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explaining an operation of the data processing apparatus 
shown in FIG. 1. 

The data processing apparatus 1 according to the 
present embodiment performs removing processing as shown 
5 in FIG. 12B on a pixel of a noise component which is 
smaller than a predetermined sized region ar_thl , for 
example, as shown in FIG. 12A based on the binarized 
image data S1806 generated in the above processing. 

Also, the data processing apparatus 1 performs 

10 processing of connecting pixel data g21 and g22 having 
the same pixel value within a predetermined distance 
ar_th2, for example, based on the binarized image data 
SI 80 6 shown in FIG. 12C, and generates image data having 
a linear pattern g2 , for example, shown in FIG. 12D. In 

15 the present embodiment, the linear patter corresponds to 
an example of a pattern indicating blood vessels. 

Specifically, the data processing apparatus 1 
performs degeneration processing by using the minimum 
pixel data among pixel data in the first region around 

20 the pixel data as predetermined pixel data for each of a 
plurality of pixel data composing image data and 
indicating pixel values, and expansion processing by 
using the maximum pixel data among pixel data in the 
second region being larger than the first region around 

25 the pixel data as predetermined pixel data for each pixel 
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data by the degeneration processing; and generates image 

data including a linear pattern* 

In the present embodiment, the above functions are 

realized, for example, by using the Morphology function. 
5 FIG. 13A to FIG. 13F are views for explaining the 

degeneration processing and expansion processing of the 

data processing apparatus shown in FIG. 1. 

Based on the image data SI 806, for each of the 

plurality of pixel data composing the image data S1806 
10 and indicating pixel values, a first degeneration (erode) 

processing portion 1807 generates image data S1807 by 

using the minimum pixel data among pixel data in the 

first region around the pixel data as predetermined pixel 

data, and output this to the first expansion processing 
15 portion 1808. 

Specifically, for example as shown in FIG. 13A, the 

first degeneration processing portion 1807 uses the 

minimum pixel data among pixel data in a cross -shaped 

element ELI as a first region, wherein focused pixel data 
20 g_att is at the center, as a pixel value of the focused 

pixel g__att. In the present embodiment, as shown in FIG. 

13B, the minimum value "0" is used as the focused pixel 

data g__att. 

Based on the image data S1807, for each of a 
25 plurality of pixel data composing the image data S1807 
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and indicating pixel values, the first expansion (dilate) 
processing portion 1808 generates image data S1808 by 
using the maximum pixel data among pixel data in the 
first region around the pixel data as predetermined pixel 
5 data, and outputs the same to the second expansion 
processing portion 1809. 

Specifically, for example as shown in FIG. 13A, the 
first expansion processing portion 1808 uses the maximum 
pixel data among pixel data in the cross-shaped element 
10 ELI as a first region, wherein the focused pixel data 

g__att is at the center, as a pixel value of the focused 
pixel g__att. In the present embodiment, as shown in FIG. 
13C, the maximum value 1 is used as the focused pixel 
data g_att. 

15 Based on the image data S1808, for each of a 

plurality of pixel data composing the image data S1808 
and indicating a pixel value, the second expansion 
processing portion 1809 generates image data S1809 by 
using as predetermined pixel data the maximum pixel data 

20 among pixel data in the second region being larger than 
the first region around the pixel data, and outputs to 
the second degeneration processing portion 1810. 

Specifically, the second expansion processing 
portion 1809 uses as a pixel value of the focused pixel 

25 g_att the maximum pixel data among pixel data in a 3x3 
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rectangular shaped element EL2, wherein the focused pixel 
data g_att is at the center, as a second region being 
larger than the first region, for example as shown in FIG. 
13D. In the present embodiment, for example as shown in 
5 FIG. 13E, the maximum value 1 is used as the focused 
pixel data g__att. 

In the present embodiment, an explanation will be 
made by taking a 3x3 element as an example, but the 
present invention is not limited to the embodiment. For 

10 example, it may be a desired size of 5x5 and 7x7, etc. 

Based on the image data S1809, for each of a 
plurality of pixel data composing the image data S1809 
and indicating pixel values, the second degeneration 
processing portion 1810 generates image data S1810 by 

15 using as predetermined pixel data the minimum pixel data 
among pixel data in the second region being larger than 
the first region around the pixel data. 

Specifically, the second degeneration processing 
portion 1810, for example as shown in FIG. 13D, the 

20 minimum pixel data among pixel data in the 3x3 

rectangular element EL2, wherein the focused pixel data 
g_att is at the center, as the second region being larger 
than the first region, is used as a pixel value of the 
focused pixel g__att. In the present embodiment, as shown 

25 in FIG. 13F, the minimum value 0 is used as the focused 
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pixel data g_att. 

FIG. 14A to FIG. 14C are views for explaining an 
operation of* the data processing apparatus shown in FIG. 
1. FIG. 15 is a flowchart for explaining an operation of 
5 the data processing apparatus shown in FIG. 1. With 

reference to FIG. IOC, FIG. 14A to FIG. 14C and FIG. 15, 
an operation of the data processing apparatus will be 
explained by particularly focusing on degeneration 
processing and expansion processing. 

10 In a step ST21, based on the image data S1806, for 

example shown in FIG. 10C, the first degeneration 
processing portion 1807 generates image S1807 as shown in 
FIG. 14A by using as a pixel value of the focused pixel 
g_att the minimum pixel data among pixel data in a cross- 

15 shaped element ELI as the first region, wherein the 

focused data is at the center, for example as shown in 
FIG. 13A. 

As a result of the first degeneration processing, 
the first degeneration processing portion 1807 generates 
20 image data S1807, wherein pixel data being smaller than a 
predetermined size is removed. 

In a step ST22, based on the image data S1807, for 
example shown in FIG. 14A, the first expansion processing 
portion 1808 generates image data S1808 shown in FIG. 14B 
25 by using as a pixel value of the focused pixel g__att the 
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maximum pixel data among pixel data in the cross -shaped 
element ELI as the first region, wherein the focused 
pixel data g_att is at the center, for example as shown 
in FIG. 13A. 

5 In a step ST23, based on image data S1808, for 

example shown in FIG. 14B, the second expansion 
processing portion 1809 generates image data S1808 by 
using as a pixel value of the focused pixel g__att the 
maximum pixel data among pixel data in a 3x3 rectangular 

10 shaped element EL2 , wherein the focused pixel data g_att 
is at the center, as a second region being larger than 
the first region, for example as shown in FIG. 13D. 

From the processing in the above steps ST22 and 
ST23, the first expansion processing portion 1808 and the 

15 second expansion processing portion connect pixel data 
having the same pixel value within a predetermined 
distance ar_th2 and generates image data having a linear 
pattern . 

In a step ST24 , for example based on image data 
20 S1809, the second degeneration processing portion 1810 

generates image data S1810, for example, as shown in FIG. 
14C by using as a pixel value of the focused pixel g_att 
the minimum pixel data among pixel data in a 3x3 
rectangular shaped element EL2 , wherein the focused pixel 
25 data g_att is at the center, as a second region being 



larger than the first region, for example as shown in FIG. 
13D. 

As explained above, for each of a plurality pixel 
data composing the image data S1806 and indicating pixel 
5 values, the first degeneration processing portion 1807 

for generating image data S1807 by using as predetermined 
pixel data the minimum pixel data among pixel data in the 
first region around the pixel data, the first expansion 
processing portion 1808 for generating image data S1808 

10 by using as predetermined pixel data the maximum pixel 
data among pixel data in the first region around the 
pixel data, the second expansion processing portion 1809 
for generating image data S1809 by using as predetermined 
pixel data the maximum pixel data among pixel data in the 

15 second region being larger than the first region around 
the pixel data, and the second degeneration processing 
portion 1810 for generating image data S1810 by using as 
predetermined pixel data the minimum pixel data among 
pixel data in the second region being larger than the 

20 first region around the pixel data; it is possible to 

leave a linear pattern and fine pattern can be removed as 
noise components . 

The low-pass filter portion 1811 performs filter 
processing for leaving a linear pattern, for example, 

25 based on the image data S1810 and generates image data 
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S1811. 

Specifically, the low-pass filter portion 1811 
specifies low frequency component data than a threshold 
value for leaving the linear pattern by frequency 
5 components in the two-dimensional Fourier space obtained 
by performing two-dimensional Fourier transform 
processing on the image data S1810, performs inverse two- 
dimensional Fourier transform processing on the specified 
data, and generates image data S1811. 

10 FIG. 16A to FIG. 16F are views for explaining an 

operation of first low-pass filter processing of the data 
processing apparatus shown in FIG. 1. With reference to 
FIG. 16A to FIG. 16F, an operation of the low-pass filter 
portion 1811 will be explained. 

15 The low-pass filter portion 1811 according to the 

present embodiment performs low-pass filter processing by 
changing a threshold value for a plurality of times, for 
example three times, for highly accurately extracting a 
linear pattern. 

20 A threshold value of frequency components for 

leaving the linear pattern will be explained. 

For example, when assuming that the abscissa axis 
is x components in the Fourier space and the ordinate 
axis is y components in the Fourier space, the low-pass 

25 filter portion 1811 sets a region ar_ref to be a 
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reference of a threshold value in the Fourier space as 
shown in FIG. 16A. 

In the present embodiment, for example as shown in 
FIG. 16A, a rhombic reference region ar_ref is set in the 
5 360x360 Fourier space, wherein the origin point 0 is set 
to be the center. As shown in FIG. 16B, a region ar_ref 
including the reference region ar_ref and obtained by 
enlarging the reference region by a predetermined 
magnification is set, and the region ar_ref is used as a 

10 low-pass filter. 

In the first low-pass filter processing, for 
example as shown in FIG. 16C, a low-pass filter ar_LPFl 
is set, so that a region ar__h indicating high frequency 
components is cut in the Fourier space. The region ar_h 

15 corresponds, for example, to a geometrically symmetric 
pattern and an approximate circular pattern, etc. in an 
real -space. By cutting the region ar_h, the above 
geometrically symmetric pattern can be removed. 

As the threshold value, for example as shown in FIG. 

20 16C, a region ar_LPFl surrounded by (180, 150), (150, 

180), (-150, 180), (-180, 150), (-180, -150), (-150, 180), 
(150, -180) and (180, -150) in the two-dimensional 
Fourier space is set. The region ar_LPFl corresponds, for 
example, to a linear pattern in an actual space. By 

25 specifying the region ar_LPFl , the linear pattern can be 



specified. 

The low-pass filter portion 1811 specifies low 
frequency component data in the region ar_LPFl in the 
Fourier space as shown in FIG. 16C based on image data 
5 S101, for example shown in FIG. 16D, as the image data. 
For example, when the specified low frequency component 
data is subjected to inverse two-dimensional Fourier 
transform processing, for example, an image S102 shown in 
FIG. 16E is obtained. For example, a pixel value of the 
10 image data S102 is subjected to binarization processing 

(for example, rounding up 6 or more and rounding off 5 or 
less) , image data S103 shown in FIG. 16F is obtained. 

FIG. 17A to FIG. 17E are views for explaining an 
operation of second low-pass filter processing of the 
15 low-pass filter portion. 

The low-pass filter portion 1811 sets a region 
being larger than the region ar_LPFl as a threshold value 
of low-pass filter processing and performs filter 
processing for a plurality of times. 
20 The low-pass filter portion 1811 sets a region 

being larger than the region ar_LPFl , for example, shown 
in FIG. 17A as explained above, such as a region ar_LPF2 , 
for example, shown in FIG. 17B. 

In the second low-pass filter processing, 
25 specifically, as the threshold value, for example as 
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shown in FIG. 17B, a region ar_LPF2 surrounded by (180, 
156), (156, 180), (-156, 180), (-180, 156), (-180, -156), 
(-156, -180), (156, -180), (180, -156) is set in the two- 
dimensional Fourier space. 
5 In the second low-pass filter processing, for 

example, as image data after the first low-pass filter 
processing, based on the image data S102 shown in FIG. 
16C and FIG. 17C, the low-pass filter portion 1811 
specifies low frequency component data in the region 

10 ar_LPF2 in the Fourier space shown in FIG. 17B. For 

example, when the specified low frequency component data 
is subjected to two-dimensional Fourier transform 
processing, an image S104 shown in FIG. 17D is obtained. 
For example, when a pixel value of the image data S104 is 

15 subjected to binarization processing (for example, 

rounding up 6 or more and rounding off 5 or less) , image 
data SI 05 shown in FIG. 17E is obtained. 

FIG. 18A to FIG. 18E are views for explaining an 
operation of a third low-pass filter processing of the 

20 low-pass filter portion. 

As third low-pass filter processing, the low-pass 
filter portion 1811 sets a region being larger than the 
region ar_LPF2 shown in FIG. 18A as explained above, a 
region ar__LPF3, for example as shown in FIG. 18B. 

25 In the third low-pass filter processing, 

L 
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specifically, as the threshold value, for example as 
shown in FIG. 18B, a region ar_LPF3 surrounded by (180, 
157), (157, 180), (-157, 180), (-180, 157), (-180, -157), 
(-157, -180), (157, -180), (180, -157) is set in the two- 
5 dimensional Fourier space. 

In the third low-pass filter processing, for 
example, as image data after the second low-pass filter 
processing, based on the image data S104 shown in FIG. 
17D and FIG. 18A, the low-pass filter portion 1811 

10 specifies low frequency component data in the region 
ar_LPF3 in the Fourier space shown in FIG. 18A. 

For example, when the specified low frequency 
component data is subjected to inverse two-dimensional 
Fourier transform processing, an image S106 for example 

15 shown in FIG. 18D is obtained. For example, when a pixel 
value of the image data S106 is subjected to binarization 
processing (for example, rounding up 6 or more and 
rounding off 5 or less) , image data S107 shown in FIG. 
18E is obtained. 

20 FIG. 19A to FIG. 19F and FIG. 20A to FIG. 20C are 

views for explaining an operation of the low-pass filter 
portion of the data processing apparatus shown in FIG. 1. 
FIG. 21 is a flowchart for explaining an operation of the 
low-pass filter portion of the data processing apparatus 

25 shown in FIG. 1. With reference to FIG. 14C, FIG. 19A to 



. J ■ . 50 

FIG. 19F, FIG. 20A to FIG. 20C and FIG. 21, an operation 
of the low-pass filter portion 1811 will be explained. 

In a step ST31, the low-pass filter portion 1811 
performs two-dimensional Fourier transform processing on 
5 the image data S1810, for example, shown in FIG. 14C and 
FIG. 19A as the first low-pass filter processing, sets a 
region ar__LPFl to cut corners ar_h as high frequency 
components in the Fourier space, specifies low frequency 
component data in the region ar_LPFl , performs inverse 

10 two-dimensional Fourier transform processing, and 

generates image data S18011 shown in FIG. 19B (ST32) . For 
example, when the image data S18011 is subjected to 
binarization processing (for example, rounding up 6 or 
more and rounding off 5 or less) , image data S18103 shown 

15 in FIG. 19C is obtained. 

In a step ST33, as the second low-pass filter 
processing, the low-pass filter portion 1811 performs 
two-dimensional Fourier transform processing based on the 
image data S18102 shown in FIG. 19B and FIG. 19D, sets a 

20 region ar_LPF2 , for example shown in FIG. 17B, for 

example, being larger than the region ar_JLPFl , specifies 
low frequency component data in the region ar__LPF2 , 
performs inverse two-dimensional Fourier transform 
processing, and generates image data S18014 shown in FIG. 

25 19E (ST33) . For example, when binarization processing 



(for example, rounding up 6 or more and rounding off 5 or 
less) is performed on the image data S18014, image data 

518105 shown in FIG. 19F is obtained. 

In a step ST34 , as the third low-pass filter 
5 processing, based on the image data S18104 shown in FIG. 
19E and FIG. 20A, the low-pass filter portion 1811 
performs two-dimensional Fourier transform processing, 
sets, for example, a region being larger than the region 
ar_LPF2, for example a region ar_LPF3 shown in FIG. 18B 
10 (ST34) , specifies low frequency component data in the 

region ar_LPF3 (ST35) , performs inverse two-dimensional 
Fourier transform processing to generate image data 

518106 shown in FIG. 20B, performs binarization 
processing (for example, rounding up 6 or more and 

15 rounding off 5 or less) on the image data S18106, and 
generates the image data S1811 shown in FIG. 19F. 

As explained above, as a result that the low-pass 
filter portion 1811 specifies low frequency components 
comparing with the threshold value to leave a linear 

20 pattern by frequency components in the two-dimensional 
Fourier space obtained by performing two-dimensional. 
Fourier transform processing on image data so as to leave 
the linear pattern in the image data, and the specified 
low frequency component data is subjected to inverse two- 

25 dimensional Fourier transform processing; a linear 



pattern can be extracted. Also, by removing high 
frequency component data comparing with the threshold 
value, it is possible to remove a geometrically symmetric 
pattern, for example, an approximately circular pattern. 
5 Also, since the low-pass filter portion 1811 

performs low-pass filter processing for a plurality of 
times by making the filter region ar_LPF larger, a linear 
pattern can be extracted with higher accuracy. 

FIG. 22A to FIG. 22C are views for explaining an 

10 operation of a mask portion and a skeleton portion of the 
data processing apparatus shown in FIG. 1. 

The data processing apparatus 1 extracts a region 
to be used for authentication from image data. In the 
present embodiment, the data processing apparatus 1 

15 extracts a region including a pattern indicating blood 
vessels in image data as a region to be used for 
authentication. 

The mask portion 1812 extracts a region P_N to be 
used for authentication, for example, in the image data 

20 S1811 shown in FIG. 20C, and removes a pattern P_ct not 
to be used for authentication. 

Specifically, based on the image data S1811, the 
mask portion 1812 generates a mask pattern P_M as shown 
in FIG. 22A to extract the region P_N to be used for 

25 authentication in the image data S1811, extracts a region 
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indicated by the mask pattern P_M from the image data 
S1811, and generates image data S1812, for example, shown 
in FIG. 22B. 

The skeleton portion 1813 generates image data 
5 S1813 by performing skeleton processing based on the 

image data S1812 . Also, the skeleton portion 1813 outputs 
the image data S1813 as a signal S102 to the 
authentication unit 103. 

Specifically, the skeleton portion 1813 performs 

10 degeneration processing by using the Morphology function 
based on the image data S1812, for example, shown in FIG. 
22B, makes a pattern indicating blood vessels thin and 
generates image data S1813 obtained by extracting only 
the center portion of the pattern. The image data S1813 

15 shown in FIG. 22C indicates an image, wherein black and 
white are inversed for a plain explanation. 

Based on the signal S102 from the extraction unit 
102, the authentication unit 103 performs matching 
processing with registered image data D_P stored in the 

20 memory unit 17 in advance, and performs authentication 
processing . 

FIG. 23 is a flowchart for explaining an overall 
operation of the data processing apparatus shown in FIG. 
1. With reference to FIG. 23, an operation of the data 
25 processing apparatus 1 will be explained plainly. In the 



present embodiment, an explanation will be made on the 
case where a picture of a body of a subject h, for 
example a finger, is taken to generate image data, a 
pattern indicating veins of the finger in the image data 
5 is extracted, and authentication processing is performed 
based on the pattern. 

In a step ST101, the CPU 18 makes the irradiation 
portion 1011 of the image pickup system 101 irradiate a 
near infrared ray to the finger of the subject h. In the 

10 image pickup unit 11, RGB image data Sll is generated 

based on a transmitted light inputted through the subject 
h and the optical lens 1012. 

In a step ST102, the gray scale conversion portion 
1801 performs, for example, conversion to gray scale of 

15 256 tones based on the RGB signal Sll, and outputs this 
as a signal S1801 to the distribution data generation 
portion 1802. 

In the present embodiment, the image pickup system 
101 generates the RGB image data Sll, but the present 

20 invention is not limited to this embodiment. For example, 
in the case where the image pickup system 101 generates 
gray scale image data Sll, processing of the gray scale 
conversion portion 1801 in the step ST102 is not 
performed and the image data Sll is output to the 

25 distribution data generation portion 1082. 



In a step ST103, in the distribution data 
generation portion 1802, based on the signal S1801, for 
example, when assuming the abscissa axis c is a tone 
value (also referred to as a pixel value) and the 
5 ordinate axis f is the number (also referred to as a 

degree) of the pixel data, for example as shown in FIG. 
4C, histogram is generated as distribution data dl for 
pixel data indicating pixel values in a 25 6- tone range as 
a first range rl . 

10 In a step ST104 , in the specifying portion 1803, 

based on the signal S1802, for example as shown in FIG. 
5A, for the distribution data dl , a range of not more 
than the maximum pixel value of rll among pixel values 
rll, rl2, rl3 and rl4 by the number of predetermined 

15 threshold value V_th in the first range rl is specified 

as a second region r2 , and outputs this as a signal S1803. 

Based on the signal S1803, the mapping portion 1804 
maps pixel data in the second region r2 specified by the 
specifying portion 1803 among a plurality of pixel data 

20 to the first region rl , generates second image data 

composed of the mapped pixel data, and outputs this as a 
signal S1804 to the Gaussian filter 1805. 

Specifically, for example in the case where a range 
of pixel values of 0 to 110 is the second range r2 as 

25 shown in FIG. 4C, the mapping portion 1804 performs 
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mapping by enlarging the pixel data to the first range rl 
as a range of* pixel values of 0 to 256 as shown in FIG. 
4D, enlarges the center portion of the image data 
including blood vessel information as shown in FIG, 4E , 
5 and generates second image data S1804 (ST105) . 

In a step ST106, for example, the selection portion 

1814 detects noise distribution characteristics of the 
signal S1804 , and outputs to the noise removing filter 

1815 a signal S1814 to select any (at least one) noise 
10 removing filter suitable to the noise characteristics 

from a plurality of noise removing filters based on the 
detection results. For example, the selection portion 
1814 outputs to the noise removing filter 1815 a signal 
S1814 to select the Gaussian filter 1815_1 and the 
15 Gaussian Laplacian filter 1815_10 for the noise removing 
processing . 

In the noise removing filter 1815, any noise 
removing filter is selected in accordance with the signal 
S1814 and, for example, the Gaussian filter 1815_1 and 

20 the Gaussian Laplacian filter 1815_10 are selected. For 
convenience of the explanation, the Gaussian filter 
1815_1 and the Gaussian Laplacian filter 1815_JL0 are 
respectively explained as the Gaussian filter 1805 and 
the Gaussian Laplacian filter 1806. 

25 The Gaussian filter 1805 performs noise removing 
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processing shown in the formulas (1) and (3) based on the 
signal S1804, for example, shown in FIG. 10A, generates 
image data S1805, for example, shown in FIG. 10B and 
outputs to the Gaussian Laplacian filter 1806. 
5 In a step ST107, the Gaussian Laplacian filter 1806 

performs edge enhancement processing based on the signal 
S1805, for example, shown in FIG. 10B, generates and 
outputs image data SI 80 6, for example, shown in FIG. 10C. 
At this time, the image data S1806 is a binarized image 
10 data. 

The Gaussian Laplacian filter 1806 performs 
binarization processing based on a threshold value 
regulated in the first region rl shown in FIG. 4C when 
performing binarization processing. 

15 In a step ST108, based on the image data S1806, for 

example, shown in FIG. 10C, the first degeneration 
processing portion 1807 generates image S1807 as shown in 
FIG. 14A by using as the focused pixel g_att the minimum 
pixel data among pixel data in a cross-shaped element ELI 

20 as the first region, wherein the focused pixel data is at 
the center, for example, as shown in FIG. 13A. 

In a step ST109, based on the image data S1807, for 
example, shown in FIG. 14A, the first expansion 
processing portion 1808 generates image data S1808 as 

25 shown in FIG. 14B by using as the focused pixel g_att the 



maximum pixel data among pixel data in a cross-shaped 
element ELI as the first region, wherein the focused 
pixel data is at the center, for example, as shown in FIG. 
13A. 

5 In a step ST110, based on the image data S1808, for 

example, shown in FIG. 14B, the second expansion 
processing portion 1809 generates image data S1809 by 
using as the focused pixel g_att the maximum pixel data 
among pixel data in a 3x3 rectangular shaped element EL2 
10 being larger than the first region, for example, as shown 
in FIG. 13D, wherein the focused pixel data is at the 
center. 

In a step ST111, for example, based on the image 
data S1809, for example, as shown in FIG. 13D, the second 

15 degeneration processing portion 1810 generates image data 
S1810, for example, as shown in. FIG. 14C by using as the 
focused pixel g_att the minimum pixel data among pixel 
data in a 3x3 rectangular shaped element EL2 , wherein the 
focused pixel data is at the center. 

20 In a step ST112, as first low-pass filter 

processing, the low-pass filter portion 1811 performs 
two-dimensional Fourier transform processing on the image 
data S1810, for example, shown in FIG. 14C and FIG. 19A, 
sets a region ar_LPFl to cut corners ar_h as high 

25 frequency components in the Fourier space, for example, 



as shown in FIG. 16C, specifies low frequency component 
data in the region ar_LPFl , and performs inverse two- 
dimensional Fourier transform processing to generate 
image data S18011 shown in FIG, 19B. 
5 As second low pass filter processing, the low-pass 

filter portion 1811 performs two-dimensional Fourier 
transform processing based on the image data S18102 shown 
in FIG. 19B and FIG. 19D, sets, for example, a larger 
region than the region ar_LPFl , for example, a region 

10 ar_LPF2 shown in FIG. 17B, specifies low frequency 
component data in the region ar_LPF2 , and performs 
inverse two-dimensional Fourier transform processing to 
generate image data S18014 shown in FIG. 19E. 

As third low-pass filter processing, the low-pass 

15 filter portion 1811 performs two-dimensional Fourier 

transform processing based on the image data S18104 shown 
in FIG. 19E and FIG. 20A, sets, for example, a larger 
region than the region ar__LPF2 , for example, a region 
ar_LPF3 shown in FIG. 18B, specifies low frequency 

20 component data in the region ar_LPF3, performs inverse 

two-dimensional Fourier transform processing to generate 
image data S18016 shown in FIG. 20B, performs 
binarization processing (for example, rounding up 6 or 
more and rounding off 5 or less) on the image data S18016 

25 (ST113) and generates image data S1811 shown in FIG. 19F. 
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In a step ST114, to extract a region P_N to be used 
for authentication from the image data S1811 based on the 
image data S1811, the mask portion 1812 generates a mask 
pattern P_M as shown in FIG. 22A, extracts a region 

5 indicated by the mask pattern P_M from the image data 

S1811, and generates image data S1812, for example, shown 
in FIG. 22B. 

In the step ST114, the skeleton portion 1813 
performs degeneration processing by using the Morphology 

10 function based on the image data S1812, for example, 

shown in FIG. 22B, makes a focused pattern, for example, 
a pattern indicating blood vessels thin as shown in FIG. 
22, generates image data S1813 obtained by extracting 
only the center portion of the pattern, and outputs as a 

15 signal S102 to the authentication unit 103. 

In the authentication unit 103, matching processing, 
for example, with pre- registered image data D_P stored in 
the memory unit 17 is performed based on the signal S102, 
and authentication processing is performed. 

20 As explained above, the data processing apparatus 1 

generates distribution data by the distribution data 
generation portion 1802, for example, as shown in FIG. 5A 
and FIG. 5B, specifies a second region by the specifying 
portion 1803, maps the second region to the first region 

25 by the mapping portion 1804, and generates third image 



data by binarization based on a threshold value regulated 
in the first region rl by components 1805 to 1812; 
therefore, binarization can be suitably performed even in 
the case where distribution data dl of pixel values 
5 differs for each subject h. 

Also, as a result that the selection portion 1814 
for selecting any noise removing processing among a 
plurality of noise removing processing and a noise 
removing filter 1815, for example, having a plurality of 

10 different kinds of noise removing filters are provided, 
for example, a filter selected, for example, by the 
selection portion 1814 performs noise removing processing 
based on the signal S1804, then, the Gaussian Laplacian 
filter 1806 performs edge enhancement processing and 

15 binarization; it is possible to remove noises caused by 
diffused reflection of a body of the subject h and image 
pickup unit 11 and other devices, for example, from the 
image data S1804, and suitably binarized image data can 
be generated based on the predetermined threshold value 

20 of the first region rl . 

Also, for each of a plurality of pixel data 
composing the image data S1806 and indicating pixel 
values, the first degeneration processing portion 1807 
for generating image data SI 807 by using as predetermined 

25 pixel data the minimum pixel data among pixel data in the 



. . 62 

first region around the pixel data, the first expansion 
processing portion 1808 for generating image data S1808 
by using as predetermined pixel data the maximum pixel 
data among pixel data in the first region around the 

5 pixel data, the second expansion processing portion 1809 
for generating image data SI 80 9 by using as predetermined 
pixel data the maximum pixel data among pixel data in the 
second region being larger than the first region around 
the pixel data, and the second degeneration processing 

10 portion 1810 for generating image data S1810 by using as 
predetermined pixel data the minimum pixel data among 
pixel data in the second region being larger than the 
first region around the pixel data; it is possible to 
remove regions being smaller than a predetermined size 

15 and to connect between pixel data close to a certain 
extent to each other. Furthermore, it is possible to 
leave a linear pattern, and a pattern as noise components 
can be removed. 

Also, as a result that the low-pass filter portion 

20 1811 specifies low frequency component data comparing 
with the threshold value to leave a linear pattern by 
frequency components in the two-dimensional Fourier space 
obtained by performing two-dimensional Fourier transform 
processing on image data so as to leave the linear 

25 pattern in the image data, and performs inverse two- 
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dimensional Fourier transform processing on the specified 
low frequency component data, it is possible to extract a 
linear pattern. Also, a geometrically symmetric pattern 
can be removed. 
5 Also, as a result of performing a series of 

processing operations, for example, a pattern indicating 
blood vessels of a subject h can be extracted with high 
accuracy. 

Also, it is possible to extract a pattern 
10 indicating individually unique vein of blood vessels with 
high accuracy, so that authentication with higher 
accuracy can be performed based on the pattern. 

Also in a conventional data processing apparatus, 
troublesome processing of using an AI filter for blood 
15 vessel tracing based on blood vessel information from 

image data was performed. However, in the data processing 
apparatus 1 according to the present embodiment, it is 
possible to extract a pattern indicating blood vessels 
with high accuracy based on image data obtained by taking 
20 a picture of a subject h, so that a load on processing 
becomes lighter comparing with that in the conventional 
case. 

Also, the skeleton portion 1813 extracts the center 
portion of a pattern indicating blood vessels when 
25 performing skeleton processing, thus, it is possible to 



generate skeleton image data less affected by expansion 
and contraction of blood vessel, for example, along with 
changes of physical conditions of the subject h. Since 
the authentication unit 103 uses the image data for 
5 authentication processing, it is possible to perform 

authentication processing with high accuracy even when a 
physical conditions of the subject h change. 

Also, the present embodiment can be realized by 
combining filters requiring light processing, therefore, 

10 an individual authentication system with a high 
processing speed can be developed. 

FIG. 24 is a view for explaining a second 
embodiment of a remote-control device using the data 
processing apparatus according to the present invention. 

15 A remote-control device (also referred to as a 

remote controller) la according to the present embodiment 
is a general remote controller provided therein with the 
data processing apparatus 1 according to the first 
embodiment . 

20 Specifically, as same as the data processing 

apparatus according to the first embodiment, for example, 
shown in FIG. 2, the remote-control device la comprises 
an image pickup unit 11, an input unit 12, an output unit 
13, a communication interface 14, a RAM 15, a ROM 16, a 

25 memory unit 17 and a CPU 18. An explanation will be made 
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only on different points from the data processing 
apparatus 1 according to the first embodiment. 

In the remote- control apparatus la, for example, an 
irradiation portion 1011, an optical lens 1012 and the 
5 image pickup unit 11 as an image pickup system 101 are 
provided to a body portion 100. 

The output portion 13 transmits a control signal to 
make a television set m_tv perform predetermined 
processing by using an infrared ray as a carrier wave, 
10 for example, by being controlled by the CPU 18. For 

example, the output unit 13 is composed of an infrared 
ray light emitting element. 

The television set m__tv performs predetermined 
processing in accordance with a control signal received 
15 at a light receiving portion m_r, for example, displaying 
predetermined image on a display portion m__m. 

The memory unit 17 stores, for example, data D_t 
indicating users' preferences, specifically, a preference 
list D_jt as shown in FIG. 24. The data D_t is read and 
20 written in accordance with need by the CPU 18. 

The CPU 18 performs processing, for example, in 
accordance with the data D_t when authentication is 
performed normally. 

FIG. 25 is a flowchart for explaining an operation 
25 of the remote-control device la shown in FIG. 24. 



In a step ST201, whether a user touched the image 
pickup system 101 provided on the side surface of the 
body portion 100 is determined. For example, when a 
finger touched the image pickup system 101, the procedure 
5 proceeds to processing in a step ST202. 

In the step ST202, by the CPU 18, a near infrared 
ray is irradiated from the irradiation portion 1011 to a 
finger of the subject h, and the image pickup unit 11 
generates image data of finger blood vessels based on a 
10 transmitted light. In the present embodiment, a light 

irradiated from the irradiation portion 1011 is used, but 
the present invention is not limited to this embodiment. 
For example, the image pickup unit 11 may generate image 
data based on the transmitted iight of the subject h by a 
15 natural light. 

In a step ST203, the CPU 18 extracts image data to 
be used for authentication by the extraction unit 102, 
for example, skeleton image data indicating a pattern 
indicating blood vessels, and outputs as a signal S102 to 
20 the authentication unit 103. 

In a step ST204, the CPU 18 makes the 
authentication unit 103 perform authentication processing 
by comparing the signal S102 with users' registered image 
data D_P stored in the memory unit 17 in advance. 
25 In a step ST205, when the authentication unit 103 
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recognizes it is not the user stored in advance, the 
procedure returns back to the processing in the step 
ST201. 

On the other hand, when the authentication unit 103 
5 recognizes it is the user stored in advance in the 
determination in the step ST205, the CPU 18 performs 
processing in accordance with the data D__t indicating 
preference of the user stored in the memory unit 17. For 
example, a control signal in accordance with the data D_t 
10 is output to the television set m_tv. 

As explained above, in the present embodiment, 
since a remote-control device comprising the data 
processing apparatus according to the first embodiment is 
provided, for example, it is possible to control the 
15 television set m__tv based on the authentication result. 

Also, for example, age and other information are 
included in the data D_t. When the user is determined to 
be underage as a result of the authentication by the 
authentication unit 103, an age limiting function can be 
20 realized by performing limiting processing, such that the 
CPU 18 invalidates a specific button to keep programs on 
the television blocked, etc. 

Also, the data D_t includes display of program 
listing (a preference list and history, etc.) customized 
25 for each user and use of programmed recording list, etc. 
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The CPU 18 is capable of performing processing in 
accordance with the respective users by controlling that 
the data can be used when authentication by the 
authentication unit 103 is normal. 
5 Also, a plurality of predetermined data may be 

registered for each user in the data D_t. 

FIG. 26 is a view for explaining a third embodiment 
of the data processing system using the data processing 
apparatus according to the present invention. 

10 A data processing system 10b according to the 

present embodiment comprises, as shown in FIG. 26, a 
remote-control device la, a recording medium (also 
referred to as medium) lb, a data processing apparatus lc 
and a television set m_tv. An explanation will be made 

15 only on different points from the first embodiment and 
the second embodiment. 

In the present embodiment, for example, both of the 
remote-control device la and the recording medium lb 
perform the above identification processing, and 

20 processing in accordance with both of the identified 
results is performed. For example, when a user of the 
remote-control device la and a user of the recording 
medium lb are identical, reading and writing of 
predetermined data stored in the recording medium lb are 

25 performed . 
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The remote-control device la has the approximately 
same configuration as that of the remote-control device 
la according to the second embodiment and includes the 
data processing apparatus 1 according to the first 
5 embodiment . 

The recording medium lb comprises, for example, the 
data processing apparatus 1 according to the first 
embodiment . 

For example, the recording medium lb is a video 
10 tape and other magnetic recording media, an optical disk, 
a magneto-optical disk, a semiconductor memory, and other 
data recording media. 

As same as in the first embodiment, for example 
shown in FIG. 2, the recording medium lb comprises an 
15 image pickup unit 11, an input unit 12, an output unit 13, 
a communication interface 14, a RAM 15, a ROM 16, a 
memory unit 17 and a CPU 18. An explanation will be made 
only on different points from the data processing 
apparatus 1 according to the first embodiment. 
20 In the recording medium lb, an irradiation portion 

1011, an optical lens 1012 and the image pickup unit 11 
are provided as an image pickup system 101 to a body 
portion 100. 

The image pickup system 101 is preferably provided 
25 at a position touched by a user on the body portion 100b. 
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When a position touched by a user is not determined, the 
image pickup unit 11 is provided not only at one position 
but at regions that could possibly be touched by a user 
on the body portion 100b. 
5 The data processing apparatus lc is capable of 

reading and writing data stored by the recording medium 
lb, for example, when authentication is performed 
normally. For example, the data processing apparatus lc 
includes the data processing apparatus according to the 

10 first embodiment. For example, the data processing 
apparatus lc comprises, as same as in the first 
embodiment shown in FIG. 2, an image pickup unit 11, an 
input unit 12, an output unit 13, a communication 
interface 14, a RAM 15, a ROM 16, a memory unit 17 and a 

15 CPU 18. An explanation will be made only on different 

points from the data processing apparatus 1 according to 
the first embodiment. 

Furthermore, the data processing apparatus lc 
comprises, for example, a holding portion m_Ji for holding 

20 the recording medium lb, a driver for performing reading 
and writing of data of the recording medium lb held by 
the holding portion m__h, and a light receiving portion 
m_r , etc . 

A television set m_tv comprises a display portion 
25 mm for displaying an image based on data, for example, 



from the driver of the data processing apparatus lc. 

FIG. 27 is a flowchart for explaining an operation 
of the data processing system shown in FIG. 26. With 
reference to FIG. 27, an explanation will be made only on 
5 different points from the first embodiment and the second 
embodiment on an operation of the data processing system 
10b. 

An operation of the remote-control device la in the 
steps ST301 to ST304 is the same as that in the steps 
10 ST201 to ST204 in the second embodiment, so that the 
explanation will be omitted. 

In a step ST304 , the CPU 18 of the remote-control 
device la makes the authentication unit 103 compare a 
signal S102 with registered image data D_P of a plurality 
15 of users stored in advance in the memory unit 17 to 
perform authentication processing. 

In a step ST305, when it is identified to be not a 
user stored in advance in the authentication unit 103 of 
the remote-control device la, the procedure returns back 
20 to the processing in the step ST301 . 

On the other hand, in determination in the step 
ST305, when it is identified to be a user stored in 
advance in the authentication unit 103, the CPU 18 stores, 
for example, the identified result is stored as A in the 
25 memory unit 17 (ST306) . 
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In the step ST307, for example, a user sets the 
recording medium lb at the holding portion m_h of the 
data processing apparatus (also referred to as a 
reproduction apparatus) lc. 
5 In a step ST308, in the recording medium lb, for 

example, whether the user touched the image pickup system 
101 provided on the side surface of the body portion 100b 
is distinguished. When, for example, a finger touched the 
image pickup system 101, the procedure proceeds to 

10 processing in a step ST309. 

In the step ST309, the CPU 18 of the recording 
medium lb makes the irradiation portion 1011 irradiate a 
near infrared ray to the finger of the subject h and 
makes the image pickup unit 11 generate image data of the 

15 finger vein based on a transmitted light. 

In a step ST310, the CPU 18 of the recording medium 
lb extracts by the extraction unit 102 image data, for 
example, skeleton image data indicating a pattern 
indicating blood vessels to be used for authentication in 

20 the same way as in the first embodiment, and outputs this 
as a signal S102 to the authentication unit 103. 

In a step ST 311, the CPU 18 of the recording 
medium lb makes the authentication unit 103 compare the 
signal S102 with the registered image data D_P of a 

25 plurality of users stored in advance in the memory unit 
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17 to perform authentication processing. 

In a step ST312, when it is identified to be not a 
user stored in advance in the authentication unit 103 of 
the recording medium lb, the procedure returns back to 
5 the processing of the step ST308. 

On the other hand, in determination in the step 
ST312, when it is identified to be a user stored in 
advance in the authentication unit 103 of the recording 
medium lb, the CPU 18 of the recording medium lb sets the 
10 identified result as B (ST313) . 

In a step ST314, the identified result A by the 
step ST306 and the identified result B by the step ST313 
are compared and determined whether they are an identical 
user or not. 

15 The determination processing may be performed in 

the recording medium lb. In this case, the recording 
medium lb performs processing based on the identified 
result A sent from the remote-control device la and the 
identified result B by the recording medium lb. 

20 Also, the determination processing may be performed, 

for example, in the data processing apparatus lc. In this 
case, the data processing apparatus lc performs 
processing based on the identified result A sent from the 
remote-control device la and the identified result B by 

25 the recording medium lb. 
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When determined to be an identical user as a result 
of the determination processing in the step ST314, for 
example, the recording medium lb allows the data 
processing apparatus lc to read and write, for example, 
5 to reproduce and record built-in data (ST315) , while when 
determined to be not an identical user, for example, the 
recording medium lb prohibits the data processing 
apparatus lc to reproduce and record the built-in data 
(ST316) . 

10 For example, when determined to be an identical 

user, for example, the data processing apparatus lc reads 
data built in the recording medium lb and makes the 
television set m_tv display an image in accordance with 
the data on the display portion m_m. 

15 As explained above, in the present embodiment, 

since identification is performed by both of the remote- 
control device la and the recording medium lb, for 
example, when it is an identical user from the identified 
result, it is possible to make the recording medium lb 

20 store and read data. Therefore, for example, data 

falsifying, a stealthy glance and overwriting on data, 
etc. by other people can be prevented. 

FIG. 28 is a view for explaining a fourth 
embodiment of a portable communication device using the 

25 data processing apparatus according to the present 



invention . 

The portable communication device Id according to 
the present embodiment includes the data processing 
apparatus according to the first embodiment. 
5 For example, the portable communication device Id 

has a general call function, an email function and an 
address book function, etc. and activates a predetermined 
function in the case of a pre-registered user as a result 
of the above authentication processing, but does not 

10 activate a predetermined function in the case of a not 
registered user. 

The portable communication device Id comprises, for 
example, as same as in the first embodiment shown in FIG. 
2, an image pickup unit 11, an input unit 12, an output 

15 unit 13, a communication interface 14, a RAM 15, a ROM 16, 
a memory unit 17 and a CPU 18. An explanation will be 
made only on different points from the data processing 
apparatus 1 according to the first embodiment. 

In the portable communication device Id, an image 

20 pickup system 101 is provided, for example, to a call 

button bt, etc. (may be all buttons bt) as the input unit 
12. 

For example, the portable communication device Id 
obtains an image of finger vein when a button bt is 
25 operated by the user and, when it is identified to be an 
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already registered individual, activates a communication 
function as a cellular phone, and activates a desired 
call function via a not shown base station. 

FIG. 29 is a flowchart for explaining an operation 
5 of the data processing apparatus shown in FIG. 28. With 
reference to FIG. 29, an operation of the portable 
communication device Id will be explained on different 
points from the data processing apparatus according to 
the first to third embodiments. 

10 In a step ST401, for example, whether a user 

touched the image pickup system 101 provided to a call 
button bt, etc. as the input unit 12 or not is 
distinguished. When, for example, a finger touched the 
image pickup system 101, the procedure proceeds to a step 

15 ST402. 

In a step ST402, the CPU 18 makes the irradiation 
portion 1011 irradiate a near infrared ray to the finger 
of the subject h and makes the image pickup unit 11 
generate image data of the finger vein based on a 

20 transmitted light. 

In a step ST4 03, the CPU 18 extracts by the 
extraction unit 102 image data, for example, skeleton 
image data indicating a pattern indicating blood vessels 
to be used for authentication in the same way as in the 

25 first embodiment, and outputs this as a signal S102 to 
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the authentication unit 103. 

In a step ST 404, the CPU 18 makes the 
authentication unit 103 compare the signal S102 with the 
registered image data D_P of users stored in advance in 
5 the memory unit 17 to perform authentication processing. 

In a step ST405, when it is identified to be a pre- 
registered user in the authentication unit 103, a 
communication function as a cellular phone is activated 
and the user is permitted to use the cellular phone 
10 (ST406) . 

For example, when a user as a holder of the 
portable communication device Id lends the portable 
communication device Id to other person (ST407) , the 
portable communication device Id determines whether the 
15 user as a holder operated a specific button (ST408) . 

In determination in the step ST408, when it is 
determined that the specific button bt is operated, the 
CPU 18 makes the predetermined function able to be 
operated by other person. The user as a holder lends the 
20 portable communication device Id in that state to other 
person (ST409) . 

On the other hand, in the step ST408, in the case, 
where the CPU 18 determines that the specific button bt 
is not operated by the identical person, and in the case 
25 of not lending to other person, a series of processing 
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finishes . 

On the other hand, in the determination in the step 
ST405, when it is identified to be not a pre-registered 
user in the authentication unit 103 and when the 
5 identification processing is not failed for a plurality 
of times (ST410) , the procedure returns back to the step 
ST401. 

On the other hand, when the identification 
processing failed for a plurality of times, the CPU 18 
10 prohibits the authentication processing (ST411) , and the 
CPU 18 sends data indicating that the authentication 
processing failed for a plurality of times, for example, 
to a data communication device PC registered in advance 
(ST412) . 

15 As explained above, in the present embodiment, the 

portable communication device Id activates a 
predetermined function when it is approved to be a pre- 
registered user as a holder from the result of the above 
authentication processing, it is possible to prevent the 

20 device from being used by other people, for example, in 
case of loss. 

Also, for example, in the case of not a pre- 
registered user, received emails, not to mention the 
address book, and transmission history, etc. cannot be 

25 viewed, so that the security is tight. 
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Also, by registering data indicating an address, 
such as a mail address, in advance in the memory unit 17 
and providing, for example, a GPS (global positioning 
system) function, information of a present position of 
5 the portable communication device Id can be sent to a 
data communication device PC at an already registered 
address, for example, when keys are pressed for a 
plurality of times by someone other than the pre- 
registered user (when authentication failed for a 

10 plurality of times) . 

Also, by storing address book data ad of the user 
in a server device sv accessible via a not shown 
communication network separately from the portable 
communication device Id and, for example, when the user 

15 is appropriately authenticated in the portable 

communication device Id, accessing by the CPU 18 of the 
portable communication apparatus Id to the server device 
sv via the not shown communication network to download 
the user's address book data, it is possible to prevent 

20 other users from improperly browsing the address book. 

In this case, for example, even when other portable 
communication device Id is used, it is possible to use 
the same address book data ad when authentication is 
appropriately attained by the portable communication 

25 device Id. 
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Also, when the user as a holder of the portable 
communication device Id needs to lend the portable 
communication device Id to other person with own 
acknowledgement, it is possible to allow other person to 
5 use it by an operation of an exclusive button bt by the 
holder himself /herself . Namely, when a specific button 
bt is operated, the CPU 18 activates a predetermined 
function without performing authentication processing 
even in the case of being used by other person. 
10 FIG. 30 is a view for explaining a fifth embodiment 

of the data processing apparatus according to the present 
invention . 

A telephone le using the data processing apparatus 
according to the present embodiment comprises the data 
15 processing apparatus 1 according to the first embodiment 
and has an individual authentication function by finger 
vein . 

For example, in the telephone le according to the 
present embodiment, an image pickup system 101 is 

20 provided to a specific button bt, etc. (may be all 

buttons or its body) provided to the respective household 
in the same way as in the portable communication device 
Id according to the fourth embodiment. The configuration 
of the telephone le is approximately the same as that of 

25 the portable communication device Id according to the 
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fourth embodiment. Only different points will be 
explained* 

The telephone le obtains an image of finger vein, 
for example, when a button bt is pressed. Also, the 
5 telephone le has a use limiting function and an 
individual identification function. 

Also, the telephone le has a limiting function for 
setting the maximum usable time for each user in advance 
and inactivating calls when reaching to a predetermined 
10 time . 

Also, for example in the case of a length phone 
call, when it is set to perform authentication only when 
a button is pressed for the first time, it is not always 
the case that the same person would use afterwards, so 

15 that it is preferable to provide the image pickup system 
101, for example, to a receiver le_r and take a picture 
of finger vein of a subject h regularly to continuously 
perform authentication processing. 

Also, the telephone le regularly performs 

20 authentication processing and updates registered image 
data in the memory unit 17. 

Also, for example, in the telephone le, different 
beep sound can be registered for each user, and, for 
example, a beep sound corresponding to the user can be 

25 output from a not shown speaker. 
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FIG. 31 is a flowchart for explaining an operation 
of the telephone shown in FIG. 30. With reference to FIG. 
31, an operation of the telephone le will be explained. 
For example, the case where the telephone le is used by a 
5 plurality of users will be explained. 

In a step ST501, when the CPU 18 receives a signal 
indicating calling from other telephone, it specifies the 
user based on the other party's telephone number, etc. 
and let beep sound corresponding to the user output from 
10 the speaker . 

Whether individual identification by beep sound is 
used or not is determined (ST502) and, when individual 
identification is used, the CPU 18 makes the image pickup 
system 101 irradiate a light to a user's finger and take 
15 a picture of the finger (ST504) when the finger of the 
user corresponding to the beep sound touches the image 
pickup system 101 of a receiver, etc. (ST503) . 

In a step ST505, the same processing as in the data 
processing apparatus 1 according to the first embodiment 
2Q is performed and image data including a pattern 
indicating blood vessels is generated. 

In a step ST506, the CPU 18 compares the generated 
image data with a list of registered image data stored in 
the memory unit 17. 
25 In a step ST507, identification timeout or not, 
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that is, whether a processing time taken for 
identification processing is longer than a predetermined 
time or not, is determined; and whether identification is 
attained or not is determined if it is within the 
5 processing time (ST508) . 

When identification is appropriately attained by 
the determination in the step ST507 , the CPU 18 sets to 
enable to call (ST509) . 

On the other hand, when identification cannot be 

10 attained appropriately by the determination in the step 
ST507, the procedure returns back to the step ST504 to 
repeat measurement. But when it becomes timeout in the 
step ST507, it is switched, for example, to a so-called 
answerphone function (ST510) . 

15 On the other hand, in the step ST502, it is also 

switched to an answerphone function in the same way when 
the beep sound is not his/her own. 

On the other hand, in the step ST501, in the case 
of not receiving a call but making a call, the CPU 18 

20 determines whether, for example, a user's finger touched 
the image pickup system 101 (ST551) . When, for example, a 
finger touched the image pickup system 101, the procedure 
proceeds to a step ST512 . 

In the step ST512, the CPU 18 makes the irradiation 

25 portion 1011 irradiate a near infrared ray to the finger 



of the subject h, and makes the image pickup unit 11 
generate image data of finger vein based on a transmitted 
light . 

In a step ST513, the CPU 18 extracts by the 
5 extraction unit 102 image data to be used for 

authentication, for example, skeleton image data 
indicating a pattern indicating blood vessels in the same 
way as in the first embodiment, and outputs as a signal 
S102 to the authentication unit 103. 
10 In a step ST514, the CPU 18 makes the 

authentication unit 103 compare the signal S102 with the 
registered image data D_P of users stored in advance in 
the memory unit 17 to perform authentication processing. 

In a step ST515, when it is identified to be not an 
15 already stored user in the authentication unit 103, the 
procedure returns back to the processing in the step 
ST511. 

On the other hand, when it is identified to be an 
already stored user in the authentication unit 103 in the 
20 determination in the step ST515, the CPU 18 displays on 
the display portion of the output unit 13 address book 
data ad of the identified user (ST516) and sets to enable 
to call (ST517) . 

For example, during a call, in the step S518, 
25 whether a use time is set or not is determined. 
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When it is set, the CPU 18 determines whether it is 
within a usable time or not (ST519) and determines 
whether the call is ended when it is within the usable 
time (ST520) . 

5 On the other hand, in the step ST519, when it is 

not within the usable time, an alert or indication of an 
alert is displayed on the display portion for the user, 
and the call is forcibly disconnected (ST521) . 

On the other hand, in the step ST518, when the use 
10 time is not set and when the call ended in the step ST520, 
a series of processing finishes. 

As explained above, in the present embodiment, the 
telephone le has the data processing apparatus according 
to the first embodiment therein, and a use time can be 
15 set, so that, for example, a lengthy phone call can be 
prevented. 

Also, it is possible to apply a system wherein 
billing of phone charges is divided for the respective 
users and the payment of the phone charges is made by 
20 each user. 

Also, the image pickup system 101 was provided to a 
button bt, but the present invention is not limited to 
this embodiment. For example, it may be provided to a 
receiver le_r, etc. or provided to both of the button bt 
25 and the receiver le r, and the both may be used 



appropriately depending on the situation. 

Also, being different from the portable 
communication device, the telephone le can be used by a 
plurality of users, for example, all family members can 
5 use the same telephone, and it displays an address book 
for an identified user, preferable operationally is 
attained. 

Also, when receiving a call, since beep sound can 
be set for each user and it can be set that only an 
10 identified individual can answer the phone, the security 
is tight. 

Also, by performing individual identification at 
the time of picking up the receiver, and setting to 
enable to talk in the case of a preset user, tight 
15 security is attained. 

Also, when the preset user is absence, it can be 
switched to an answerphone, for example, even if other 
family is at home, so that tight security is attained. 

FIG. 32 is a view for explaining a sixth embodiment 
20 of the data processing apparatus according to the present 
invention . 

A PDA (personal digital assistant) If according to 
the present embodiment comprises the data processing 
apparatus 1 according to the first embodiment. 
25 For example, as shown in FIG. 32, in the PDA If, an 
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image pickup system 101 is provided to a side surface of 
the body portion or a button bt. 

For example, when a user touches the PDA If, an 
image of finger vein is obtained, and it can be used in 
5 the case of an identical person as a result of 
authentication . 

Alternately, it is set that private data can be 
displayed only in the case of an identical person as a 
result of authentication. 
10 FIG. 33 is a view for explaining a seventh 

embodiment of the data processing apparatus according to 
the present invention. 

A mouse lg according to the present embodiment is a 
so-called mouse as an input device of, for example, a 
15 personal computer PC, etc. and comprises the data 

processing apparatus 1 according to the first embodiment. 

In the mouse lg, an image pickup system 101 is 
provided, for example, to a button bt, etc. 

For example, when a user touches a button bt of the 
20 mouse lg, an image of finger vein is obtained, and it is 
set that login to the personal computer is possible only 
in the case of an identical person as a result of 
authentication. For example, it may be used for turning 
on the power of the personal computer PC and displaying a 
25 login screen, etc. 
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Note that the present invention is not limited to 
the present embodiment and a variety of any suitable 
modifications can be made. 

An explanation was made on an example wherein the 
5 data processing apparatus 1 was built in a remote -control 
device and a portable communication device, but the 
present invention is not limited to these embodiments. 

For example, a keyboard may be provided with the 
image pickup system 101 to take a picture of* a subject h 

10 during key input, and authentication processing may be 
performed based on the taken image data . 

Also, when using net-shopping, etc. , a picture of a 
subject h is taken during inputting necessary information, 
and authentication processing may be performed based on 

15 the taken image data. In this case, it is made to be a 
mechanism wherein only an identical person can make an 
order. Also, by using it together with the credit card 
number and password, etc. , double management can be 
attained and the security is furthermore improved. 

20 Also, the image pickup system 101 may be provided 

to a touch panel of, for example, a bank ATM (automatic 
teller machine) , etc. A picture of a subject h is taken 
when inputting necessary information, and authentication 
processing may be performed based on the taken image data. 

25 For example, by setting that cash can be withdrawn when a 
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person is identified to be an identical person, the 
security is improved. 

Also, when using together with a cash card and 
password, etc., the security is furthermore improved. 
5 Also, the image pickup system 101 may be provided, 

for example, to a house key and a mail post, etc. to take 
a picture of a subject h, and authentication processing 
may be performed based on the taken image data. By 
providing a mechanism of opening a door when 

10 appropriately identified, the security is improved. Also, 
when it is used together with a key, etc. , the security 
is furthermore improved. 

Also, the data processing apparatus 1 may be 
provided, for example, to a bicycle to take a picture of 

15 a subject h, and authentication processing may be 

performed based on the taken image data. By providing a 
mechanism of turning on and off of the key when 
appropriately identified, the security is improved. Also, 
when it is used together with the key, the security is 

20 furthermore improved. 

Also, for example, it may be used in place of 
signature when using a credit card. For example, by 
providing the data processing apparatus 1 to a 
reader/writer of a credit card, etc. , it becomes possible 

25 to display the card number, for example, when 
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identification is appropriately attained, to confirm 
matching with own card. 

Also, by using together with a card, etc., the 
security is furthermore improved. Also, by using them 
5 together, it is possible to prevent misusage of the card 
or key in case of loss. 

Industrial Applicability 
The present invention can be applied to, for 
10 example, an image processing apparatus for performing 

processing on image data obtained by taking a picture of 
a subject. 



